Striping without Sacrifices: Maintaining POSIX Semantics in a Parallel File System
نویسندگان
چکیده
Striping is a technique that distributes file content over multiple storage servers and thereby enables parallel access. In order to be able to provide a consistent view across file data and metadata operations, the file system has to track the layout of the file and know where the file ends and where it contains gaps. In this paper, we present a light-weight protocol for maintaining a consistent notion of a file’s layout that provides POSIX semantics without restricting concurrent access to the file. In an evaluation, we show that the protocol scales and elicit its corner cases.
منابع مشابه
Striping without Sacri ces: Maintaining POSIX Semantics in a Parallel File System
Striping is a technique that distributes le content over multiple storage servers and thereby enables parallel access. In order to be able to provide a consistent view across le data and metadata operations, the le system has to track the layout of the le and know where the le ends and where it contains gaps. In this paper, we present a light-weight protocol for maintaining a consistent notion ...
متن کاملA First Implementation of Parallel IO in Chapel for Block Data Distribution
This paper presents our preliminary implementations of parallel IO routines in Chapel, a high-productivity parallel language for large-scale systems. The IO functions are implemented using standard Chapel features, taking POSIX as the IO middleware layer and Lustre as the target parallel file system. In this work, we focus on the Chapel Block data distribution, for which we propose different al...
متن کاملBigfoot - NFS : A Parallel File - Striping NFS Server ( Extended
Bigfoot-NFS allows the transparent use of the aggregate space of multiple NFS file servers as a single file system. By presenting a single apparent file system to the user, Bigfoot-NFS allows the use of available storage without the maintenance overhead of tracking multiple mounted file systems. Unlike most other network parallel file systems, Bigfoot-NFS runs without a central “metadata” serve...
متن کاملAn Effective Storage Mechanism for High Performance Computing (HPC)
All over the process of treating data on HPC Systems, parallel file systems play a significant role. With more and more applications, the need for high performance InputOutput is rising. Different possibilities exist: General Parallel File System, cluster file systems and virtual parallel file system (PVFS) are the most important ones. However, these parallel file systems use pattern and model ...
متن کاملA Semantics-Aware I/O Interface for High Performance Computing
File systems as well as I/O libraries offer interfaces which can be used to interact with them, albeit on different levels of abstraction. While an interface’s syntax simply describes the available operations, its semantics determine how these operations behave and which assumptions developers can make about them. There are several different interface standards in existence, some of them dating...
متن کامل